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1 Introduction 

The study of the strong law of large numbers (SLLN) for compact-valued random 
sets was started by Artstein and Vitale ^2^, with their seminal 1975 paper. Ever 
since, significant extensions and developments have been obtained by several au- 
thors, including Puri and Ralescu [1^1 [IS]; Cressie [B], Hess [HI IS], Artstein and 
Hansen Ij, Hiai [10,, Teran and Molchanov [321. A systematic presentation of the 
status of the theory and the multivalued analysis prerequisites can be found in 
the monographs of Molchanov [T^], Hu and Papageorgiou [T^ and Castaing and 
Valadier ^5j. 

In the SLLN for compact-valued random sets, it is somehow natural to inves- 
tigate convergence in the sense of the Pompeiu-Hausdorff metric h. This type of 
convergence does not seem to be appropriate for random sets which are merely 
bounded and closed-valued and thus, in this case, the SLLN has been studied by 
using weaker modes of convergence, like Wijsman's convergence [24] or Mosco's 
convergence [ITl |4] . 

In the present paper we consider a SLLN for random sets with bounded and 
closed values contained in an arbitrary (not necessarily separable) Banach space 
and, in this context, we shall use a notion of convergence, namely Fisher's conver- 
gence, which is stronger than Wijsman's convergence but in general not comparable 
with Mosco's convergence. 

More precisely, denote by E an arbitrary real Banach space and by £(E) (resp. 
£c(E)) the space of all nonempty bounded closed (resp. nonempty bounded closed 
and convex) subsets of E endowed with the Pompeiu-Hausdorff metric h. Let 
(f2,j2/, P) be a complete probability space without atoms and let li be a closed 
and separable subset of £(E). Let {Xn}n=i be a sequence of independent identi- 
cally distributed (i.i.d.) random sets X„ : n —>■ U. If, in addition, for w e f2 
almost surely (a.s.) the sequence {Ar„(w)}^^^ is compact in £(E), then it is shown 
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(Theorem lO)) that 



> C a.s. on il. (1.1) 

n 

Here the convergence is in the sense of Fisher, and C e £c(IE) is the expectation 
of Xi. Moreover, if C is compact, the convergence in (11.11) is in the Pompeiu- 
Hausdorff metric h. 

To prove the above resuh, we first consider the corresponding sequence of ran- 
dom sets {cdXn}n fi and, using the Radstrom's embedding theorem, we show (The- 
orem [OJ that 



coXi(w) -I \- coXn{u}) h „ „ 

> C a.s. on il, 

n 

where the convergence is in the Pompeiu-Hausdorff metric h. Hence, a fortiori, 



coXi{uj) + ■■■ + coXn{uj) F 

— ^-^ — > C a.s. on il, (1.2) 

n 

From this, by virtue of a convexification in the limit resuh (Theorem l4.ip . it foUows 
that 

Xijuj) + ---+Xn{uj) f 

> C a.s. on il, (1.3) 

n 

and thus (jl.ip is vahd. 

We observe that the precompactness of {Xn{Ld)}^Z\ in £(E) is actuahy required 
in order to deduce (|1.3p from (|1.2p . Furthermore, it is worth noting that the 
separabihty of U in £(E) does not imply that the set U = <j{X \ X e U} he 
separable in E and, similarly, the compactness of the sequence {Xn{uj)}^'fi does 
not imply that the set V = u{X„(u;) | n 6 N} be precompact in E. To see this it 
suffices to consider U = {B} and Xn{uj) = B for each rt e N, where B is the closed 
unit ball of an infinite dimensional non-separable Banach space. 

The present paper is organized into six sections, including the Introduction. 
Section [3] contains notations and preliminaries. In Section [3] we review some ele- 
mentary properties of various notions of convergence in spaces of sets. In Sections 
|3]we establish a convexification in the limit result for Fisher convergent sequences 
of sets in £(E). In Section [5] we introduce a notion of expectation for random sets 
with values in £(E), where the underlying Banach space E is not necessarily sepa- 
rable. Finally in Section [S] we present two versions of the SLLN, with Fisher-type 
convergence, for i.i.d. random sets with values in £c(IE) and £(E) respectively. 



2 Notation and preliminaries 

Let M be a metric space with distance (Im- For Z <z M, we denote by BM{a,r) 
and Bm[o., r] an open and a closed ball in M with centre a and radius r. For any 
Z M, Z stands for the closure of Z in M. If a e M and Z is a nonempty subset 
of M, we set dM{a,Z) = \ni{dM{a,z) \ z e Z). The Pompeiu-Hausdorff distance 
hM{X,Y) between two nonempty bounded sets X,Y <^ M is defined by 

hM {X,Y)= max{eM {X,Y), eu {Y.X)) 
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where eM{X,Y) = aup{dM{x,Y) \ x e X} and eM{Y,X) = sup{dM{y,X) \ y e ¥}. 

Throughout the present paper E is a real Banach space with norm || • ||. The 
open (resp. closed) unit ball with centre at the origin of E are denoted by Be (resp. 
-Be)- Moreover coX and WX stand for the convex hull and the closed convex hull 
of a set X c E. For any nonempty sets X, y c E and A ^ the sum X + Y and 
the product \X are given by 

X +Y = {x + y\ x€X,y€Y}, \X = {\X\x€X}. 

We define 

Q5(E) = {X c E I X is nonempty bounded} 
£(E) = {X c E I X is nonempty closed bounded} 
£c(E) = {X c E I X is nonempty closed convex bounded}. 

It is worth noting that in each of the above spaces the Pompeiu-Hausdorff distance 
/ie(X, y) between two sets X^Y is given, cquivalently, by 

/iE(X,y) = infix (=y + rB,ycX + rB}. 

r>0 

The spaces £(E) and £c(IE) are equipped with the Pompeiu-Hausdorff distance /ie, 

under which each one of them is a complete metric space. On the other hand, /ig is 
a pseudometric on *B(E) since /ie(X, y) = 0, where X, y e *B(E), does not imply 
X = y. For X 6 *B(E) we set ||X|| = sup{||a;|| | a; e X}. 

For a sequence {X„}^5i c *B(E) and X e Q3(E) we shall consider the following 
notions of convergence. 

Definition 2.1. The sequence {Xn}n=i is said to converge to X in the sense of 
Pompeiu-Hausdorff (we write X„ X) if lim„_>+oo /i(X„,X) = 0. 

Definition 2.2. The sequence {X„}+^j^ is said to converge to X in the sense of 
Fisher (we write X„ — > X) if 

(01) lim„^+oo eE(X„,X) = 

(02) lim„^+oo d^{z, Xn) = for every 2; 6 E. 

Definition 2.3. The sequence {Xn}n=i is said to converge to X in the sense of 
Wijsman (we write X„ X) if 

lim dE{z, Xn) = dE{z, X) for every z e X. 

Remark 2.1. Let {Xn}+Z'i <= *S(E) and X e 'B(E) be given. If 7 denotes any 
one of the above modes of convergence, i.e., convergence in the sense of Pompeiu- 
Hausdorff, Fisher or Wijsman, then we have 

Xn ~^ X <J=^ X„ X <J=^ Xn X X„ X. 

In what follows, when the role of the underlying metric space is evident and clar- 
ity is not affected, wc will drop subscripts and write d, e, h, B{a, r), B,. . . instead 
of dm, Be, hm, BE{a,r), Be, 
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3 Auxiliary results 

In this section we review a few elementary properties of convergent sequences of 
sets which will be useful in what follows. Some of them could be easily deduced 
from results contained in 4 . Yet, for the sake of completeness proofs are included. 

Proposition 3.1. Let {X„}+f^i c £(E) and X 6 £{£). Then ^ X if and 
only if: 

(i) for each z 6 X, lim„_>+,x ^n) = (equivalently there exists a sequence 
{xn}n=i c E, with Xn G Xn, such that Xn —> z as n +co). 

(a) for each z ^ X, given < e < d{z,X), there exists no e N such that 
Xn n d{z, X) — e) = for all n ^ uq. 

Proof. Suppose that Xn X. Then (i) is obvious. Arguing by contradiction, 
suppose that (ii) is not valid. Then for some z ^ X there exist < e < d{z, X) 
and a subsequence {Xn^^ }k=i -^^^k ^{^^ '^i^^ X) — e) ^ for all fc e N. 

Hence c?(z, Xn^. ) < d{z, X) — e for all fc e N, a contradiction, as d{z, Xn) d{z, X) 
for n +00. 

Suppose that {i) and (ii) are satisfied. We want to show that, for every z e E 

lim d{z,Xn) = d(z,X) (3.1) 

n— > + iX 

This is obvious ii z e X, in view of (i). Let z ^ X and, arguing by contradic- 
tion, suppose that p.ip does not hold. Then there exist < e < d{z,X) and a 
subsequence {Xn,, }k^i for which one of the following is valid: 

d{z, XnJ ^d{z,X)-e for every fc e N (3.2) 
d{z, Xn^ )^ d{z,X) + e for every fc e N (3.3) 

Consider p.2p . By virtue of (ii) there exists uq eN such that Xn r\ B{z, d{z, X) — 
e/2) = for aU ^ no. Hence d{z,Xn) < d{z,X) — e/2 for every n ^ no and 
thus for some fco e N with n^^ e N we have 

d{z, X„J ^ d{z, X) - e/2 for every k ^ ko, 

a contradiction to (j3.2l) . 

Consider p.3p . Clearly d{z, Xn^) > d{z, X) + e/2 for every fc e N and thus 

Xn^ n B{z, d{z, X) + e/2) = for every fc e N. 

Now fix X 6 X so that ||z — xl < d{z^X) + e/2. In view of (i) there exists a 
sequence {xn}n.^i, with x„ e X„, such that a;„ ^ a; an n ^ +oo. Hence for n 
large enough, say n ^ no, we have \z — < c?(z,X) + e/2 and thus, a fortiori, 
d{z,Xn) < d{z,X) + e/2 for every n ^ no. Taking ko e N so that n^^ ^ no, we 
have that 

d{z, Xnk ) < d{z,X) + e/2 for every k eN, 
a contradiction to (|3.3p . Consequently p.ip holds thus completing the proof. □ 
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Remark 3.1. In view of Proposition 13.11 we have that if a sequence {Xn}n=i 
£(E) converges in the sense of Wijsman to X e then this hmit is unique. 

Proposition 3.2. Let {X„}+f^i c €{E) and let X c Then 

Xn — > X ^ Xn — > X =^ Xn X. 

Proof. Suppose that Xn X. Then both conditions (ai) and (02) of Definition [52] 
are triviaUy satisfied since, from the assumption, e(Xn,X) and e{X,Xn) 
as n N. Hence X„ X. 

Suppose that Xn X. To prove that Xn X it suffices to show that 
both conditions {i) and (m) of Proposition 13.11 are satisfied. It is obvious that 
(z) holds. Arguing by contradiction, suppose that (m) does not. Then, for some 
z ^ X and some < e < d{z,X), there is a subsequence {Xn^}'l^^i such that 
Xnk <^ B{z, d{z, X) — e) # for every fc e N, and thus 

d{z,XnJ < d{z,X) - e for every fc e N, (3.4) 

As e{Xn;,,X) ^ for fc ^ +00, there exists ko e N such that Xn^^ c X + eB/2. 
By the latter and (13. 4p it follows that 

d{z, X) - e/2 ^ d{z, X + eB/2) ^ d{z, X„^^^ ) < d{z, X) - e, 

a contradiction. Hence also (ii) is valid and thus Xn X thus completing the 
proof. □ 

Remark 3.2. The following examples show that the Pompeiu-HausdorfF conver- 
gence is stronger than Fisher's convergence and that the latter is in turn stronger 
than Wijsman's convergence. 

Let H be a real infinite dimensional Hilbert space with inner product •) and 
induced norm || ■ ||. Let S = {x e M \ \\x\\ = 1} and B = {x e H | ||a;|| ^ 1}. Let us 
show that for each < r < 1 there exists an infinite sequence {Cn} c S such that 

||e„ — e„i II ^ r for all n, m e N, m 7^ n. (3-5) 

Let ei 6 S. Evidently S\B{ei,r) ^ and thus there exists an element 62 e S such 
that ||e2 — ei|| > r. Observe that 

5\(B(ei,r)uB(e2,r))^0 (3.6) 

In the contrary case S c {ei,e2} +rB co{ei, 62} +rB and thus B cz co{ei,e2}-l- 
rB which, by Radstrom cancellation law [3T], implies that (1 — r)B c 00(61,62}. 
This is a contradiction, as H is infinite dimensional. Since (13.61) holds, there exists 
an element, say 63 e S, such that ||63 — ei|| > r and ||e3 — 62! > r. Thus, by 
induction, one can construct a sequence {en}n=i S satisfying p.Sp . 

Example 3.1. The sequence {Xn}n^i c (rc(EI) defined by Xn = cojei, . . . , 6„}, 
with rt 6 N, satisfies 

Xn^X and Xn^X (3.7) 
where X = coE and E = {en}n^i- 
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Clearly X„ c Xn+i c X, n e N, and hence e(X„,X) = for every n 6 N. 
Moreover, 

lim d{z,Xn) = for each z e X, 

n— > + 0C' 

because, given e > 0, for some no G N we have d{z^Xng) < e and thus, a fortfori, 

F h 

d{z, Xn) < e for all n ^ no- Therefore Xn — > X. On the other hand, if Xn X 
then, denoting by a the Kuratowski measure of noncompactness [T3], we have 
lim„^+x a{Xn) = a{X). As a{X) = for each n e N, it follows that a{X) = 0, 
i.e., X is compact. This impossible since, in view of (j3.5p . the sequence {en}n=i 
X does not contain convergent subsequences. Consequently X„ -^^ X. 

Example 3.2. Let i? = {e„}^^j^ c S' be as in the previous example. Thus {cn} 
satisfies p. 51) for some < r < 1. Fix 1 < A < 2/V4 - r^. Then the sequence 
{X„}+;?^ (z G:c(H) defined by X„ = co{Ae„, S}, n e N, satisfies 

X„ ;B and Xn B. (3.8) 
Let us show that Xn B. Set p = — 1. Clearly 

B{Xen,p) n S # for every n e N, (3.9) 
since ||Ae„ — e„|| = A — 1 < p. Moreover, 

B [Ae^, p] n B [Ae^ , p] = for every i ^ j e N, (3.10) 
because for arbitrary z e B [Ae^ , p\ and z' e B [Xej , p] one has 

||z-z'|| = \\\(ei-ej) + (z-Xei)-(z' -Xej)\\ ^ A||ej -Gj || -2p ^ Ar-2VA2 - 1 > 0. 

Furthermore, let us prove that for every en & E 

yeS\B[Xen,p] Xn c {x e M \\ (x - y,y) ^ 0}. (3.11) 

Indeed, let y e 5 satisfy \\y — Ae„|| > p. This implies that {Xen,y} < 1. Since for 
each t 6 [0, 1] and z e B , 

<(1 - t)Xen +tz-y,yy={l- <)<Ae„, y) + t(z, y) - \\yf ^(1-0+^-1 = 0, 

it follows that each point of X„ is contained in the half space {x 6 M | (x—y, y) ^ 0}, 
and thus (|3.1ip is valid. 

We are now ready to prove that for every z e H 

lim d{z,Xn) = d{z,B). (3.12) 

Let z 6 M\B be arbitrary (if z e S there is nothing to prove) and denote by y the 
point at which the closed linear segment tz {0 ^ t ^ 1) meets S. In view of p.lOp 
one (and only one) of the following cases occurs: 

(j) y e B [Acfc, p] for some e E (any such is unique by p.lO[) . 

(jj) y^B [Xen,p] for every n e N. 
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Consider (j). Then by p.lOp . y ^ B [Ae„, p] for every n ^ k and hence by (|3.1ip 

Xn c {x e M \ (x — y,yy ^ 0} for every n k. 

The latter imphes that d{z,Xn) ^ \\z — y\\ since y e Xn- As d{z,B) = \\z — y\\, it 
fohows that 

d{z, Xn) = d{z, B) for every n ^ k, 

and thus ^3J2\ holds. 
Consider (jj). Then by (P1T|) . 

X„ (Z 6 H I (a; — y> ^ 0} for every n e N 

and as before one can show that p.l2p holds. Therefore Xn B. On the other 

hand X„ -5> i? because, for each n e N, we have e(X„, B) = || Ae„ — e„ || = A — 1 > 0. 
This completes the proof of (j3.7l) . 

Proposition 3.3. Let {X„}+*i, {Yn}+Z\ ^ *B(E) safe/?/ X„ -^^^ X and r„ F 
/or some X,Y e *B(E). Let {Xn}n'fi: {^nl^S such that A„ ^ A and 

iTT-n H for some A, /i ^ 0. Then 

KXn + f^nYn ^ XX + flY . (3.13) 

Proof. Let e > be arbitrary. From the assumption, there exists tiq 6 N such that 
Xn <^ X + eB and Yn Y + eB for every n ^ uq. Then for all n large enough we 
have 

KXn + finYn C A„X + + e(A„ + ^in)B ^ XX + flY + €{X+fi + 1)B 

which shows that 

lim e{XnXn + flnYn,XX + flY) = 0. (3.14) 
n— » + iX 

Let z 6 XX + iiY be arbitrary, thus z = Xx + fiy for some x e X and y e Y. As 

Xn and Yn -^Y, there exists two sequences {xn}n'^i, {yn}n^i with a:;„ e Xn 

and ?/„ 6 Yn such that x„ ^ x and yn —>■ y as n ^ +oo. Set z„ = A„x„ + /i„yn and 
observe that Zn G A„X„ + //„y„ and z„ z. Clearly d(z, A„Ar„ + ^inYn) ^ — Zn \\ 
and thus 

lim d{z, XnXn + finYn) = for every z e X + Y. (3.15) 

The statement (j3.13p is an immediate consequence of p.l4p . p.lSp and Remark 
12.11 This completes the proof. □ 

Proposition 3.4. Let {Xn}n=i, {Yn}n=i ^ €{E) and let X,Y ^ £(E). Suppose 
that Xn — * X and Yn Y as n +oo and h{Xn,Yn) < r for every n 6 N, 
r > 0. Then, h(X,Y) ^ r. 
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Proof. Arguing by contradiction, suppose that for some 6 > 0, h{X, Y) > r + 9 
and to fix ideas let e{X,Y) > r + 6 (the argument is similar if e{Y,X) > r + 9). 
Fix an X e X satisfying 

d{x,Y)>r + 9. (3.16) 

Now X e X and X„ X, hence, by Proposition l3.1[ there exists a sequence {xn}, 
with Xn G Xn, such that Xn x as n ^ +co. On the other hand, a; ^ Y" by p.l6p 

and Yn Y and thus, by Proposition 13. 1[ given < e < 9/3 there exists rii > no 
such that 

Yn n B{x, d{x, Y) — e) = for every n ^ uq. (3-17) 
From (|3.16p . as Xn x, it follows that there exists ni ^ no such that 

d{xn,Y) > r + 9 for every n^rii. (3.18) 

Take n2 > ni such that \\xn — x\\ ^ e and \d(xnY) — d(x, Y)\ < e for every ni ^ 712- 
Hence 

B{xn,d{xn,Y) — 'Se) B{x,d{x,Y) — e) for every 71^712, 
and thus by ((XT71) 

1^ n i?(x„, d(2;„, F) — 3e) = for every rt ^ 712. (3.19) 

Now fix 77 ^ 722 • Then by virtue of (|3.19|) and p.l8p one has 

d{xn,Yn) ^ d{xn,Y) - 3e > r + 9 - 3e. 

Since on the other hand d{xn,Yn) ^ e(X„,y„) ^ /i(X„,y„) < r, it follows that 
r > r + — 3e. This is a contradiction, for < e < 9/3. Therefore h{X, Y) ^ r, 
which completes the proof. □ 

Proposition 3.5. Let Z cz £(]E) be a nonempty compact set in the Pompeiu- 
Hausdorff metric h of £(E). Let {Zn}n=i "''f^d let C G £c(IE) be compact. 

Then, 

Zn >■ C => Zn — >■ C. 

Proof. It suffices to show that, given e > 0, there exist n',n" G N such that the 
following properties (j) and (jj) are satisfied: 

{j) C a Zn + eB for every n' 

(jj) Zn <^ C + eB for every n ^ n" 

Consider (j). By hypothesis Zn C and hence, by Proposition 13.11 for each 
u e C there exist G N such that d{u,Zn) < e/2 for every ti ^ 77„. Since 
d{x, Zn) ^ — u\\ + d{u, Zn), it follows that d{x, Zn) < e for every x G B{u, e/2) 
and n ^ 77„. Now, {B{u, e/2)}uEC is an open covering of C, a compact set, hence 
it admits a finite subcovering, i.e., for some mi, . . . , G C we have 

C cz B{ui, |) u ■ • ■ u B(ud, |). 
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Set n' = max{nuj , . . . , }. Since each x e C is in some ball B{ui, e/2), with 
1 ^ i ^ d, we have d(x, Z„) < e for every n ^ n' . Consequently C c Z„ + eB for 
every n ^ n' and (j) holds. 

Consider (jj). Arguing by contradiction, suppose that (jj) does not hold. Then 
there exists a subsequence {Znk}kl'i such that 

cj: C + eB for every fc e N. (3.20) 

As {Znk}k^i where 2. c £(E) is compact in the Pompeiu-Hausdorff metric h 
of £(E), there exists a subsequence {^nj. }f=i ^-^d a set Z e Z such that Z„j. Z 
as j +00. From this and p.20p it follows that Z C + {e/2)B and hence, for 
some z 6 Z, we have d{z, C) ^ e/2. Since z e Z and Z, there exists jo £ 

such that 

Z„,. n |) 7^ for all j ^ jo- (3.21) 

On the other hand, z ^ C and C, and thus by Proposition l3. II there exists 

ji 6 N such that 

Zn,^ n S(z, d(z, C)-^) = for aU j ^ ji. (3.22) 
Let j = max{jo, ji}- Then by l!^^ and ([X^ 

(i(z,Z„^.) < and d(2, ) ^ rf(z, C) - 

which yields a contradiction since d{z,C) ^ e/2. Hence also (jj) holds and this 
completes the proof. □ 



For Z a nonempty subset of £c(IE) define 



coZ = {Y e e:c(IE) \ Y = J] KX^, where X, e Z, A; e [0, 1] with ^ A, = 1, n e N}. 

Further, we denote by cl^^^g) [coZ.] the closure of coZ. in the Pompeiu-Hausdorff met- 
ric of Cc(IE). The set coZ is convex, i.e., Yi, I2 e coZ implies that (1 — A)^! -I- XY2 e 
coZ for every A e [0, 1]. Clearly the set c1£^(e) [coZ] is also convex. 

Proposition 3.6 ((Mazur's Theorem)). Let Z be a nonempty compact subset of 
€c{E) in the Pompeiu-Hausdorff metric of £c(E). Then the set c/g^fE) [coZ] is 
compact and convex. 

Proof. It suffices to show that cle^(]E)[coZ] is compact. Let e > 0. By hypothesis 
Z is compact and thus it admits a finite e/2-net {Ai,...,Ap} a Z. Let A = 
{(ai, ... ,ap) eRP \ ai e [0,l],ai + ■■■+ Up = 1}. Define $ : A ^ ^^(lE) by 



$(ai, . . . ,ap) = 2 aiAi (ai, ...,ap)eA, 
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and sot 31 = $(A). Evidently 31 is compact and thus it admits a finite e/2-net 
{Yi, . . . ,Yq} c "Ji. We want to show that {Yi, . . . , 1^} is an e-net of coZ. Indeed let 
X e co2, be arbitrary, and thus 



^ — 2 KXi, 

i=l 

for some Xi 6 Z, e [0, 1] with Ai + • • • + A„ = 1. As {Ai, . . . ,Ap} is an e/2-net 
of 2., one has that each X^, 1 ^ i n, is contained in some ball, say B{A^,e/2), 
for some A'- e {Ai, . .. , Ap}. Set 

n 

Y = Y^XiA',. 

Clearly h{X, Y) < e/2. Moreover, Y e "Ji because for some e [0, 1] with ai + 
• ■ • + ap = 1 we have 

Y = j] aiAi. 

i = l 

Since {Yi, ... ,Yq} is an e/2-nct of 31 andY e 31, it follows that Y e B(Yj,e/2) for 
some l^j^q. Whence X e B{Yj,e/2), for h{X, Yj) ^ h{X, Y) + h{Y, Yj) < e. As 
X e coZ is arbitrary, we conclude that {Yi, . . . , Y",} is an e-net of coZ and hence also 
for clir^(E^ [coZ]. Hence cl^^ (ej [coZ] is totally bounded. Furthermore c1,j^(e) [coZ] 
is complete since it is closed in £c(IE), a complete metric space. Consequently 
cl|r^(E)[coZ] is compact, completing the proof. □ 



4 Convexification in the limit results 

In this section we prove some convexification in the limit results which turn out to 
be useful for the proof of the SLLN for £(E)-valued random sets. 
For any set D e £(E) and n 6 N we set 



Proposition 4.1. LetCe€{E). Then 



F 

C[n\ — > coC as n +00 (4.1) 
Proof. Denote by Q"*" the set of positive rationals p ^ 0. Define 

d d 

Q = {x e coC I X = 2 piXi, where Xi e C,pi e Q"*", with ^ = 1, d e N} 

i — l i — 

and observe that Q e *B(E) and Q = coC. 

Indeed let z e Q be arbitrary. Then, for some xi, . . . ,Xd e C and p\,...,pd 6 N, 
we have 

z = — xi +■■■-{ Xd where Pi + ■ ■ ■ + Pd = P- 

P P 
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Moreover 

z 6 C[rt], for every n e 3 = {p, 2p, . . . , fcp, 
because for each n e 3^ say n = kp, we have 

kpixi H 1- fcpda;^ 



kp 



kpi —times 



kpd —times 



Xi + ■ ■ ■ + Xi -\ + Xd + ■ ■ ■ + Xd 

kp 

fcp— times 

c + -^-- + c ^ 

6 ; = C[n]. 



kp 

Claim. There exists a sequence {cn}n=i ^ satisfying the foUowing properties: 



Cn = z ii n = kp for k = 1,2, . 
Cn 6 C[n] for every n ^ p 
Cn —>■ z as n —>■ +C0 



(4.2) 
(4.3) 
(4.4) 



Indeed fix c e C and define the sequence {cn}n=i follows 



Xl + ■ ■ ■ + Xl +---+Xd + ■ ■ ■ + Xd+C + ■ ■ ■ + c 
kp+j 



if n = kp, k eN 

if n = kp + j, fc 6 N 
j = l,...,_p-l. 



Clearly for every fc 6 N and j = 1, 2, ... ,p — 1 we have Ckp G C[kp] and Ckp+j 6 
C[kp + j]- It is evident that the sequence {cn}n=i satisfies (|4.2p and (|4.3p . Fur- 
thermore, for any fc 6 N and j = 1, 2, ... ,p — 1, we have 



kpi -times 



kpd —times 



J— times 



Ckp-\-j ■2- 



Xl + ■ ■ ■ + Xl -\ +Xd + -- -+Xd+C+---+C 



kpi —times 



kp+j 

kpd — times 



Xl H + H \- Xd -\- ■ • ■ -\- Xd 



kp 



kpi — times 



kpd —times 



kp + j 

kpi —times 



kp Xl + ■ ■ ■ + Xl -\ + Xd + • ■ • + Xd 1 

1 :C 

n+j 



kp 

kpd —times 



Xl + ■ ■ ■ + Xl -\ + Xd + ■ ■ ■ + Xd 

kp 



kp 



kp+j 



l\z + 



kp + j 



From the latter, letting fc +oo it follows that Ckp+j z. This and (I4.2p implv 
that c„ ^ z as n ^ +00. Hence also (|4.2p is satisfied and the Claim is proved. 
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Now we are in position to complete the proof of Proposition 14.11 Evidently 
e(C[n],coC) = 0, since C[n] cz coC for each n e N. Moreover, by the Claim 

lim„^+or C[n]) = 0. As z 6 Q is arbitrary, it follows that C[n] — >■ Q as 

n +00. Hence C[n] — > Q, i.e., C[n] — > coC as n ^ +oo. Thus (|4.ip is valid 
and the proof is complete. □ 

Theorem 4.1. Let Z a £(E) be a nonempty compact set in the Pompeiu-Hausdorff 
metric h o/g:(E). Let {X„}+5-i c Z and let C e g:c(IE). Then 



coXi H h coXn F ^ 

> C as n +00 



implies 



Xi + ■ ■ ■ + Xn F „ , 

> 6 as n ^ +00. (4.5) 



n 

Proof. The statement is proved if we show: 
(j) lim„^+,x e((Xi + ■ ■ ■ + X„)/n, C) = 
(jj/J lim„_>+,x d (z, (Xi + • ■ ■ + Xn)/n) = for each z e C. 
The fact that (j) holds is obvious, since for each ti e N 

Xi+---+Xn (j\ f coXl + ■■■ + C0X„ ^ 

n ' / ^ V " ' 

and the right hand side vanishes as n —>■ +oo. 

Let us prove (jj). Arguing by contradiction, suppose that (jj) does not hold. 

Then for some z e C there exists 9 > and a subsequence {{Xi H ^Xnk )/n-k}k^'i 

such that 

z, + • • • + ^ foj. gygj.y g (-4 5) 



Let < e < 6/8. Since 2. is compact in £(E), it admits a finite e-net, say 
{Ci,C2, . ..,Cd} c Z, for some d e N. We now associate to the given sequence 
{Xn}n^i <^ ^ another sequence {C'^jit^i constructed with the following procedure. 
Consider the ordered set of balls 

{B{Ci,e),B{C2,e),...,B{Cd,e)}. 

Then for any fixed n e N, denote by the centre of the ball B{Ci, e), where i is 
the smallest index 1 ^ i ^ c? such that A"„ e B{Ci,e). Clearly h{G'^,Xn) < e for 
every n e N. Furthermore, we associate to {(^i + • • • + Ar„^)/nfe}^^j^ the following 
sequence: 

■c( + --- + C;, 



(4.7) 

Claim 1. There exists a subsequence {{C[ + ■ ■ ■ + C'j^ )/nfe^}+5^ of (|4.7p and 



there is a set F e £c(E) given by F = Yli=i KcoCi, for some Ai, . . . , ^ with 
Ai + ■ • ■ + Arf = 1, such that: 



^ ^ F as J ^ +00 (4.8) 
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and 



coC{ H h C0C4 



f^i h 



as J 



+CX). 



(4.9) 



Let us prove (|4.8p . In view of the definition of the sequence {C^j^f'i, for every 
fc 6 N there exists a partition of the set {1,2, ...,nfe} into d pairwise disjoint 
sets P„\ , , . . . , P^^ consisting, respectively, of pi^,pl^,..., p^^ elements, where 
^ ^ rife for i = 1, . . . , d and + ■ ■ • + p'^ = Uk, such that 



q = Ci for I 6 P„\, q = C2 for z 6 P^, . . . , ^ = Q for * 6 P^. 

Observe that pi, =0 whenever P^ =0. 

To fix ideas, suppose that pl^^ ^ 1 for i = l,...,d (if some pl^^ = 0, the 
argument is similar). We have 



C{ + --- + C' 



nk 



1 

nk 



1 



—times 



—times 



Pj^ —times 



Ci + ■ • ■ + Ci + C2 + • • • + C2 + • • • + + • • • + Cd 



—times 



p^ —times 



Ci + 



+ Ci 2 C2 + 



+ C2 



d Cd + • ■ • + Cd 

+< — -d 



= ^ir^cMj + ^i^cMj + ■■■ + ^^CdiptJ. (4.10) 

Ilk Ilk '^k 

For each fixed i = l,...,d the sequence {Pn^}X=i is non-decreasing, i.e., p\^^ ^ 
Puk+i every /c e N. Consider the sequence 



UpL pL pL\] 

\\nk' nk'---' nk)\^^^- 

Evidently, {pijnk , p^^/n^ , . . . , pi^/nk) e A for every fc 6 N, where 

A = {(Ai,...,Ad)|Ai ^0, i = 0,...,dandAi + ---+A<i = l}, 
and thus the sequence (|4.1ip contains a subsequence 

( / I 2 \ '\ 



(4.11) 



which converges to a limit (Ai, . . . , Ad) e A as j ^ +00. For each fixed 1 ^ i ^ d, 
if ^ +00 as i +00, then by Propositions 14.11 and 13.31 



PrLh : p 



nk, 



-C^[P' .] ^ Kmc, as J ^ +00. (4.12) 



13 



It is evident that the latter hmit remains vahd also when {p^^ bounded for, 

in this case, A, = 0. Set T = Y^t^^X^coCi. From KW\i . by virtue of (|4l^ and 
Proposition 13.31 it follows that 



Q + • ■ • + . ^ 

>■ r as J ^ +00 

and thus (|4.8I) holds. Concerning (|4.9p . it sufBces to observe that 

coC{ + • • • + coC' , 



1 



—times p^^ —times pf^ —times 



coCi + • • • + coCi + C0C2 + • • • + C0C2 H + coCd + • • • + coCd 



= — ^coCi H ^coC2 H 1 ^coCd, 

from which (|4.9I) follows at once, by letting j +00. Thus Claim 1 is valid. 
Claim 2. We have h{C,T) ^ e. 
Indeed, from and (Ol) it follows that 



coXi 


H h coX„^. . 




coC[ 


+ ---+coC4^. 



C asj^+00 (4.13) 
r asj^+00. (4.14) 



Furthermore, by construction, the sequence {C^j^^i satisfies /i(X„,C4) ^ e for 
every n e N. Hence 



^ ^ y h(Xi, C') < e for every j e N 

(4.15) 



and thus, a fortiori, 



coXi H h coX„^ . coC( H 1- coC^^ 

I < e for every j e N. 

Then by virtue of PropositionEHl in view of (|il^ - (|i?T5)) . it follows that /i(C, F) ^ 
e, and thus Claim 2 is proved. 

With the help of Claims 1 and 2 we are now in a position to complete the proof 
of {jj)- Since z e C and, by Claim 2, /i(C, F) ^ e, there exists y 6 F such that 

\\z-y\\<2e. (4.16) 
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As 7/ 6 r, then by (|4.8p there is a jo e N such that 

d y, < e for every j ^ jo- (4.17) 

V J 

Taking into account (|4.16p , (|4.17l) and (|4.15p , for every j ^ jo we have 

a contradiction to (|4.6p . since e < 6'/8. Hence also (jj) is vahd and the proof of 
the theorem is complete. □ 

Theorem 4.2. Let Z c £(E) be a nonempty compact set in the Pompeiu-Hausdorff 
metric h o/£(E). Let {X„}^*^ a Z, and let C 6 £c(IE) be a compact and convex 
set. Then 

'cdXi H VcoXn F „ , (A ',o\ 

> C as n ^ +00 (4.18) 

n 

implies 



Xi + . • . + Xn h ^ 

> G as n +00. 

n 

Proof. Let us associate to the compact set Z a £(E) the following subsets II and 
coU of £c(IE) defined as follows, 

U = {Y e g:c(E) I Y = coX for some X e Z} 

~d d 

colt = {Y e e:c(IE) \ Y = J] A,r„ where Y, e It, A, e [0, 1], ^ Ai = 1, d e N} 

i=l i=l 

Since Z is compact and, for arbitrary Ai,A2 6 £(E), ft,(coAi, co^2) ^ /i(^i,^2), 
it follows that IX is compact. Hence, by Proposition 13.61 the set Zq = c^colX] (the 
closure is taken in the /i- metric) is a convex and compact set in £c(IE). 

Let {Xn}n^i c Z he a, sequence satisfying (I4.18P with C e £c(IE) compact and 
convex. Hence, by Theorem 14. 1[ 



^1 + • ■ • + Xn F „ I A m\ 

> C as n ^ +00. (4.19) 

n 

Let e > be arbitrary. From (|4.19p . for each u e C there exists n„ e N such 

that 

X -\- • ■ • -\- X 

n B(u, e) # for every n ^ n^. (4.20) 

n 

As {B(u, e)}uec is an open covering of C it admits a finite subcovering, i.e., there 
exist ui , . . . , G C such that 

d 

C e (J B (u,, I) . (4.21) 
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Set n' = max{n„j , . . . , n„^}. Let n ^ n' he arbitrary. By (j4.20p (with Ui in the 
place of u) it foUows that each baU B{ui, e/2), i = 1, . . . ,d, contains some points 
of {Xi +---+X„)/n and thus, by (g^, 



C c + • • • + _^ foj. gyej.y ^ ^ (4 22) 



On the other hand for each n e N 



_Xi + ---+X,, coXi + ■■■+ coXn 

CO = (4.23) 

n n 

and thus, as each coXi, i = is in the convex set Zq, it fohows that 

co( Xi + ■ ■ ■ + Xn )/n e Zq for every n e N. Moreover, Zq and C are compact and 

Xl + ■ ■ ■ + Xn F „ 

CO > C as n ^ +oo, 

n 



by virtue of (|4.23l) and (|4.18p . Hence by Proposition [33 



Xl + • ■ • + Xn h „ 

CO > C as n ^ +oo. 



n 

Consequently, there exists n" e N such that 



Xl + ■ ■ ■ + Xn Xl + ■ ■ ■ + Xn ^ , o C ^ /I ^Ar,A\ 

c CO (Z 6 + eS for every n ^ n . (4.24) 

n n 

Combining (|422)) and (|4?24t yields 



Xl + ■ ■ ■ + Xn „ , „ ^ 

— , G < e tor every n ^ no, 



n 



where uq = max{n',n"}. Hence { Xi + ■ ■ ■ + Xn )/?t. ^ C as n — >■ +oo, completing 
the proof. □ 



5 Expectations of random sets in non separable 
Banach spaces 

In this section we define a notion of expectation E{F) for random sets F : ^ £(E) 
where the underlying Banach space E is not necessarily separable. A few properties 
are reviewed and some proofs will be given since, in our non separable setting, the 
Kuratowski-Ryll Nardzewski theorem is not valid. For convex valued random sets 
F : n ^ £c(E) the expectation is proven to be consistent with that obtained by 
using the classic Radstrom embedding. 

In what follows (f2,j2/,P) is a complete probability space without atoms. Fol- 
lowing Hille and Phillips [TTl pp. 71-73], a map G : V, ^ £(E) is said to be 
countably-valued if it admits a representation of the form 

G(a;) = 2 A,xa.(w) weO 

1=0 

where {Ai}'^^^ a £(E) and {rii},^^ is a measurable partition of f2, i.e., {^i}'l^i is 
a partition of VI consisting of sets Vli e . 
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Remark 5.1. It is worth noting that a countably valued map can have several 
representations. 

A map F : fl ^ C(E) is said to be strongly measurable if there exists a sequence 
{Gn}n=i of countably- valued maps G„ : ^ £(E) which converge to F uniformly 
almost surely (a.s.) on fl, i.e., 

lim hoa{Gn,F)=0 where /ioo(G'„, F) = ess sup /i(G'„(a;), 

n-> + (Xi 

It is evident that a countably-valued map is strongly measurable. 

A single- valued map / : f2 ^ E is said to be measurable if there exists a sequence 
of countably-valued maps 5„ : O — > E which converges uniformly a.s. on O to /, 
i.e., 

lim \\gn - /loo = where \\gn - /||oo = ess sup ||5f„(w) - 

A map F -.Q —>■ £(E) is said to be weakly measurable if for every x eM the map 
oj d{x,F{ui)) is measurable. 

The definition of a simple map G : f2 — > £(E) is as in the single-valued case. 

Remark 5.2. Let F : Cl ^ £(E) be a strongly measurable map. Then, wc have: 
(oi) F is weakly measurable; (02) \\F\\ is measurable, where \\F\\ : Q [0,+co) 
is defined by ||-F||(w) = a; e fl; (03) coF is strongly measurable, where 

coF : n €ciE) is defined by (coF)(w) = coF(a;), w e f2. Moreover, F : fl ^ €{E) 
is strongly measurable if and only if there exists a sequence {Gn}n=i of simple maps 
G„ : O ^ £(E) converging to F a.s. on Q. 

The meaning of E), 1 ^ p ^ +00, with the usual || ■ ||p-norm is the standard 

one. In particular. 



L'^{n,E) = {f -.n f is measurable and \ \\f\\dP < +00 



and thus each / e L^(n,E) is intcgrablc. Hero and in what follows intcgrability 
and measurability for a function / are understood in the sense of Bochner. 
Now set 

h\n, e:(E)) = |f : ^ £(E) | F is s-measurable and J \\F\\dP < +oo| 
L^(0, €c{E)) = |f : n ^ (ic{E) \ F is s-measurable and J \\F\\dP 



< +00 



and, furthermore, let 



Z^(0, e:(E)) = |f : n ^ g:(E) | F is count-valued and J \\F\\dP < +00 
€c{E)) = |f : ^ CclIE) | F is count-valued and J \\F\\dP < -Fooj . 

In the above definitions s-measurable and count-valued stand for strongly measur- 
able and countable- valued respectively. In what follows an element F e {ft, £(E)) 
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will also be called a random set. 
For any F e V-{n, c:(E)) we define 

= {/ : f2 ^ E I / is a measurable selector of F) 
V]^ = {/ : 57 ^ E I / is a countably-valued selector of F] . 

Here by a measurable (resp. countably-valued) selection of F we mean a measurable 
(resp. countably-valued) map / : 57 ^ E satisfying /(cj) 6 F(uj), uj e il. Clearly 
and are (perhaps empty) subsets of L^(J7,E). The meaning of L^(ri,W) 
and Z^(51,W), where W is a nonempty subset of S(E), is evident. 

Remark 5.3. (ai) For each G e Z^(ri, £(E)) the set is nonempty; (02) Let 
G 6 Z^(r2, £(E)) and g : f2 ^ E be bounded countably-valued maps satisfying, 
for some a > 0, d{g{u!),G{uj)) < a a.s. on ft. Then there exists a bounded 
countably-valued map g e Yq such that \\g — 5||,x ^ a- 

The following measurable selection theorem is a variant of the Kuratowski-Ryll 
Nardzewski theorem [151 E] • 

Theorem 5.1. For each F e the set Sp is nonempty. 

Proof. Let F e h\n,€{E)). Suppose first that F is bounded. Let {Gn}n=i c 
11^(0,, £(E)) be a sequence of countably-valued maps G„ : il £{E), given by 

+00 

G„H = 2Arxa?H (5.1) 
1=1 

where, for each fixed n e N, {A"}^^ c €(E) and {57"}+^^ is a measurable partition 
of ft, such that G„ converges to F uniformly a.s. on 57. Without loss of generality, 
passing to a subsequence if necessary, with the same notation as before, we can 
assume that 

hrr_ (Gn, P) < Y ^""^ ^^^"^^ n 6 N, 
where e„ = 1/2". Hence, 

hrrj(Gn, Gn+i) < for every n e N. 

Fix gi 6 Vj;^. Since %i(t^), G2(w)) ^ /i(Gi(w), G2(w)) ^ /i,x(Gi,G2) < ei a.s. 
on 57, in view of Remark 15.31 (ai), there exists 32 G V^^^ such that 

Clearly 52 e i^(f^,]E), for g2 is bounded. Similarly, we have d{g2{ijj),G3{uj)) ^ 
/i(G2(a;), G3(a;)) ^ hcf {G2,G^) < £2 a.s. on 57, and thus there exists 53 e Vq^ 
satisfying 

II 53 -52 II a, ^ £2, 

and evidently g^ e L'^'(57,E). By this procedure one can construct a sequence 
{g„}+^i c L*(57,E) with g„ e V^^ such that 

hn+i - ffnila, ^ En for every n 6 N. 
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Now {gn}n=i is a Cauchy sequence in U^-{n,E) and thus it converges to some 
(j)e U-''{n,E). Since 

d{(t){uj),F{u;)) ^ \\<j){uj) - gn{cv)\\ + d{gn{u;),Gn{uj)) + h{Gn{u;),F{uj)) a.s. onfl 

and, for n +00, \\(j){uj) — gn{i^)\\ix) and /i<x(G„(a;), F(cli)) ^ as n ^ +00, it 
follows that (/) is a measurable selection of F and thus (f> e S^p. 

Now suppose that F is not bounded. For fc e N let £7^ = {w e O | /c — 1 ^ 
< k} and observe that {flk}^^'i is a measurable partition of fi. For fc e N 
define Fk : ft ^ €(E) by Fk{uj) = F{uj), oj e £7^. As F^ is strongly measurable and 
bounded on £7^ it admits a measurable selection, say fk : i7fc E. Then the map 
f : fl given by 

+00 

i = l 

is a measurable selection of F. Therefore Sp ^ 0, completing the proof. □ 
Proposition 5.1. Let F e L^(ri, £(E)) and r > 0. Then, for each a > 0, 

SL^^S'p + {r + a)S],. (5.2) 

Proof. By Thcorcm lS. li the sets S p_^^.g and arc nonempty and, clearly, 7^ 0. 

Claim. Let ct > 0. For every <j) e Sjq-p^ there exist / e and 7 e S]^ such 
that 

(j){uj) = f{ijj) + (r + (T)"f{ijj) a.s. on f2. (5.3) 
Indeed, suppose that F and are bounded, and let (f) e S l, „ be arbitrary. Thus 



(j){uj) & F{ijj) +rB a.s. onrj. (5.4) 
Let (f>Q : fl ^ E he a. countably-valued map satisfying 

Uo-n._.<^. (5.5) 

and let {Gn}n=i Z^(il, £(E)) be a sequence of countably-valued maps Gn : ^ 
£(E), given by (|5.ip . converging to F uniformly a.s. on $7. Passing to a subsequence 
if necessary, we can assume without loss of generality that 

/i,x (G„, i^) < y for every n 6 N, (5.6) 

where e„ = tT/2"+^. Hence 

/ia,(G„, G„+i) < e„ for every n e N. (5.7) 
By virtue of (|5.5p . (j5.4p and (|5.6p (with n = 1) we have 



(/.o(w) e cj){uj) + -B c F{uj) +rB + -B c {F{uj) +rB + eB) + -B 
o 4 4 

<^ Gi{u}) + (r + ^ + eij B cz Gi(a;) + + |) ^ a.s. on 17, 
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and thus c?(0o(w), Gi{uj)) < r + a/2 a.s. on Then by virtue of Remark [531 (02), 
there exists a, gi e V^^ such that 

\\9i-Mk^r + ^B. (5.8) 

Now, by (EZl) we have d(gi(a;), G2(w)) ^ h{Gi{u}),G2{uj)) ^ /irx(Gi,G2) < ei a.s. 
on O, and thus there exists 32 e such that \\g2 — ^ ci- By this procedure 
one can construct a sequence {gn}n^i c L'^(ri,E), with (?„ e Vq^, satisfying 

llffn+i - ffniloo ^ En for cvcry n 6 N. (5.9) 

Evidently, (j5.9p imphes that {gn}^^^ is a Cauchy sequence in L'^-{n,E) and thus, 
for some / e L'-^-(ri,E), ||5„ — f\\rj-, ^ as n ^ +00. Moreover, by (|5.6p we have 
hrx.{Gn,F) as n ^ +00. Since gn{^) e G„(a;) a.s. on $7, it fohows that 
f{uj) 6 i^(w) a.s. on that is / is a measurable selection of F, and hence / e S^. 
On the other hand in view of (j5.8p and (|5.9p . 

||g„+i(w) - (/)o(w)|| ^ ||gi(w) - (/'o(w)|| + 2 ||gfc+i(w) - 5fe(^^)|| 

from which letting n — >■ +cx) one has ||/ — 0o||x ^ + 3(t/4. The latter and (|5.5p 
imply 

U-f\U<r + a. (5.10) 

Now define 7 : ^ E by 7(0;) = (0(w) — /(w))/(r + cr) for w e a.s. Since 7 6 S^, 
by (|5.10l) . / 6 S^ and, moreover, 

0(0;) = f{Lu) + (0(a;) - f{iu)) = + {r + a)"f{u) a.s. on 

it follows that (|5.3p is valid, whenever F and are bounded. The general case, 
when F and (p are not necessarily bounded, can be treated as in Theorem 15.11 and 
thus the proof is omitted. Hence the Claim is proved. The statement (|5.2p is an 
immediate consequence of the Claim. This completes the proof. □ 

Let us recall that the sum of a series SS^'i, where Gi e £c(E), is a set 
C 6 £c(E) (if it exists) such that lim„_>+rc ^(XiiLi Gi, G) = 0. Moreover, the sum 
G exists and is unique if the series is absolutely convergent, i.e., if 2]i=i ll^ill < +°°- 

Definition 5.1. Let F e Li(17, g:(E)). The Aumann integral oiF onVt (see [51 [T^) 
is defined by 

{k)\FdP=[ \ fdP\f€S]X. 

Remark 5.4. The above definition is meaningful since S^ 0, by Theorem 15. II 
Moreover, the Aumann integral of F is a set G e £c(IE) which, obviously, exists 
and is unique. 
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Let G 6 Z^(il, £c(E)) be a countably-valued map G : $7 ^ C!c(E) with represen- 
tation given by 

+ 0C. 

G(a;) = 2 AiXni(w) a; e fi, 

where {Ai]f^( <z £c(]E), and {r^i}^^ is a measurable partition of Vl. The Hukuhara 
integral of G on is defined by 



(H) [cdP = V A,P(r! 



Remark 5.5. Since the above series is absolutely convergent, it converges to a 
set G 6 £c(E), which exists and is unique. Moreover this set G is independent 
of the representation of G and thus the Hukuhara integral of G e £c{IE)) is 

meaningful. 

Definition 5.2. Let F e l^{9,Xc{^) and let {Gn}lZ\ <= I^i^Xci^)) be a 
sequence of countably-valued maps converging to F uniformly a.s. on 57. The 
Hukuhara integral of F on 17 [13] is defined by 

(H) \FdP = hm (H) \GndP. 

Remark 5.6. As in [IT, p. 79], it can be shown that the above limit exists and is 
unique, actually it is a set G e £c(E)- Moreover this set G is independent of the 
particular sequence {G„}^^j^ a (17, £c(IE)) used in the definition. Therefore the 
Hukuhara integral of F e L^(17, £c(IE)) is meaningful. 

It is worth noting that the Aumann and Hukuhara integrals are well defined 
also when 17 is replaced by a set 17' e jz/. 

Proposition 5.2. Let U.' e Then for each C e £c(]E), 

{A)\ CdP = {IT)\ CdP. (5.11) 

Moreover for each C e £(IE), 

{A) \ CdP = {H) l{coC)dP. (5.12) 

Proof. Indeed for each a e Sq, 

r adP € CP{n') = (H) r CdP, 
Jn' Jn' 

which implies that the set on the left hand side of (|5.1ip is contained in the set on 
the right hand side. Moreover, 

(H) r CdP = CP{n') = I r cdP I c 6 g1 c (A) r CdP, 
Jn' [Jn' J Jn' 
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and thus (|5.11l) holds. 

Now consider (I5.12p . Clearly by virtue of (|5.1ip 

(A) r CdP cz (A) l{coC)dP = (H) { {coC)dP. 
Jn' Jn' Jn' 

To prove the reverse inclusion, let e > and consider an arbitrary point ^ e 
icoC)P(n'). Take a ^ e (coC)P(17') such that ||C - CI < e- Clearly, for some 
a 6 C and Ai > 0, i = 1, . . . , n, with Ai + ■ • • + A„ = 1, we have ^ = P(il')(AiCi + 
• ■ • + A„c„). Now (ri,^,P) is a complete probability space without atoms, and 
thus by Liapunoff convexity theorem [7] there exists a measurable partition of fi', 
say such that P(f7,) = AiP(f}'): « = 1, Define cr : 17' ^ E by 

cr(w) = ciXoi(a;) + • • • + c„xo„(a;), for lj 6 fi'. Clearly a e Sj;. Moreover 

77^ Tt Th f\ r* 

Kc^PiQ') = V c,P(n,) = V c^xn^dP = adP 6 (A) CdP, 
and hence, as f e ^ + eP, 

^ 6 (A) C CdP + eB. 

Jo.' 

Since ^ e (coC)P(ri') and e > are arbitrary, it follows that 

{H)r(coC)rfP c {K)\cdP, 

and thus (j5.12l) is valid. This completes the proof. □ 

By virtue of Proposition 15.21 we have 
Proposition 5.3. Let d e Z^{n, ^^(E)), G2 e Z'^{n, <t{E)) and let n' e . Then, 

{A) \ GidP = (H) r GidP (A) f GadP = (P) { {-mG2)dP. 

Jw jw jw Jn' 

Proposition 5.4. Let F e Li(f2, €c(K)) and let D,' e . Then, 

(yl) I PdP = (P) I PdP. (5.13) 

Proof. Suppose first that F e h^{fl,€c{E)) is bounded. Let e > and let ^ be 
an arbitrary point in the Aumann integral of F. Then for some / e S^, setting 
^ = fdP: we have 

ll^"-eil<e- (5.14) 

Let {(l)n}n=i a-iid {Gn}n=i bc sequences of countably-valued maps converging, re- 
spectively, to / and P, uniformly a.s. on f2. Without loss of generality we can 
assume that for each n 6 N, 0„ and G„ have representations given by 

+ 0C' +x 
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where {of j+f^' cz E, {A^ j+Ji ^ €c{E), {^f}tfi is a measurable partition of fl' and, 
moreover, 

||0„-/||.x<^ /i,x,(G„,^^) < ^, neN. (5.15) 
Now, for each n eN, 

0„(w) 6 f{uj) + \\(j)n- fl-rB CZ F{uj) + -Bc G„(w) + -B a.s. on n' 

n n 

and thus, denoting by G„ : 57' £c(E) a map with representation given by 
G„H = 2"^rxn?M, wen' 



where A" = A" + B/n , it foUows that e G„(w) a.s. on 57'. Consequently 

r (/.„dP 6 (H) r G„dP. (5.16) 
Jn' Jw 

Evidently {Gn}nZ\ L^(S7', £c(IE)) is a sequence of countably-valued maps G„ : 
f7' £c(IE) converging to P uniformly a.s. on 57'. Then letting n +oo, from 
(j5.16p in view of Remark 15.61 one has 

^ = I fdP e (H) I FdP. 

Since ^ is an arbitrary point in the Aumann integral of P, from the latter and 
([SH]) it follows that 

(A) [" FdP c (H) r PdP + eS. (5.17) 

Let us prove the reverse inclusion, obtained by interchanging the roles of the 
Aumann and Hukuhara integrals. To this end, fix no G N so that no > 4/e. Then 
for every n ^ no by virtue of Proposition 15.31 and (|5.15l) we have 



(H)| G„ dP = (A)| G„rfP c (A)J P + ip ^ dP 



FdP + ^B, (5.18) 



where the last inclusion holds because, by Proposition IS . 1 1 (with r, a and replaced 
by e/r, e/4 and 17' respectively), 

^F + JB <= S], + — S^. 
From ([5]18) letting n — >■ +oo one has 

(H) 1 P dP c (A) 1 P dP + eB. 
Jn' Jn' 
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Since the Aumann and the Hukuhara integrals are closed sets and e > is arbitrary, 
from the latter and (|5.17p it follows that (I5.13P is valid. Thus the statement is 
proved, whenever F e L^(ri, £c(E)) is bounded. 

Suppose that F e L^(fl,€c(E)) is not bounded. For n e N set r2„ = {w e 
n' I ||F(a;)|| > n} and define 



Given e > fix n e N so that 



F{uj) ifujen'Xfln, 

n a CO € fin- 



r ||F||rfP < e (5.19) 



By virtue of (j5.19l) the Aumann and the Hukuhara integrals of Fn on ri„ are 
contained in the ball eB, hence 



h l{A)\FdP, {A)\ FndP 
\ Jw Jn'\n„ y 

h l{R)lFdP, Fndp] 
\ Jn' Jn'\nr, J 



< e 



< e. 



Jn'\n„ 

Since Fn is bounded on D,'\Qn , the Aumann and the Hukuhara integrals of Fn on 
fl'\fin are equal. Consequently as e > is arbitrary, (|5.13p is valid also when F is 
not bounded. This completes the proof. □ 

Proposition 5.5. For each F e £(£)) 

(A ) \FdP = (H) I {coF)dP. (5.20) 
Jn Jn 

Proof. By virtue of Proposition [53J 

(A) \FdP c (A) 1 (coF)dP = (H) 1 (coF)dP. (5.21) 
Jn Jn Jn 

To prove the reverse inclusion, let {Gn}n=i (^i ^(I^)) be a sequence of countably- 
valued maps Gn ■ fl — > £(IE) converging to F uniformly a.s. on fl. Suppose that 
each Gn has a representation given by 

Gn{oj) = f^A2xn:{oj), 

i=l 

where {Af}^J^{ c £(E), {flf}^J{ is a measurable partition of ft. Given e > take 
no G N so that 

hrc{Gn,F) < e, hnc{coGn,coF) < e for all n ^ no, (5.22) 
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the second inequality being a consequence of the first one. We have 

(H) r {coF)dP c (H) r (coG„ + eB)dP by (IK?^ 
Jo Jn 

cz (H) (coGndP + 2eB (5.23) 
Jn 

= (A) \GndP + 2eB by Proposition [Ql 

Jn 

<= (A) [" (F + £B)dP + 2eB by (lOll 

Jn 

c (A) I F dP + AeB, 
Jn 

where the latter inclusion holds by Proposition 15 . f I (with r = e and a = e/2). Com- 
bining (|5.2f I) and ([S]23), as e > is arbitrary, one obtains (j5.20p . This completes 
the proof. □ 

Definition 5.3. The expectation E{F) of a random set F e L^(f7, £(!£)) is defined 

by 

E{F) = (A) (FdP. 
Jn 

As an immediate consequence of the above definition and Proposition 15.51 we 
have the following: 

Proposition 5.6. For each random set F e 

E{F) = (H)l {coF)dP. 
Jn 

6 Strong laws of large numbers 

In this section we present two versions of the strong law of large numbers for 
random sets with values in £c(E) or in £(E), where E is an arbitrary not necessarily 
separable Banach space. Since in our approach we use a Radstrom embedding 
technique we start by reviewing some of its properties (see [211 [51). 

In what follows the space £c(IE) is equipped with the operations of addition 
X+Y and multiplication XX by non negative scalars defined, for every X,Y e £c(lE) 
and A ^ as follows 

X + Y = {x + y\xeX,yeY}, XX = {Xx \ x e X}. 

Clearly X + Y and XX are in ^^(lE)- 

The following Propositions 16.1116.31 can be proved as in [lOl [21] . 

Proposition 6.1. For arbitrary X,Y,Z 6 £c(E) and A,/i ^ we have: (ai) 
X + {0} = X; (02) X + Y = Y + X; (03) X + {Y + Z) = (X + Y)+Z; (ai) 1-X = X; 
(ag) A(m^) = {XpL)X; (as) X{X +Y) = XX + XY ; (07) (A + /i)^ = XX + iiY . 
Moreover the operations of addition and multiplication by non negative scalars are 
continuous in the topology generated by the Pompeiu-Hausdorff metric h o/£c(]E). 
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Proposition 6.2. Let A, C\ Z be non empty subsets of E and suppose that C is 
convex and Z is bounded. Then 



A + Z c C + Z ^ AcC. 
Proposition 6.3. (i) For X,Y,Z€ (ic{K) 

X + Z = Y + Z X = Y. 

(m) For X,Y,Z e ^^(E) and X ^ 

h{X + Z,Y + Z) = h{X, Y) h{\X, XY) = Xh{X, Y). 

By virtue of Propositions 16. Hl6.3l adapting some arguments from j3l [TOl [20l [2T| 

one can establish the following 

Proposition 6.4 (Radstrom embedding). There exists a Banach space (F, || • ||) 
and a map J : £c(]E) ->■ V, where V = J(£c(E)) c F such that: 

(i) J(XX + fjY) = XJ{X) + ^iJ{Y) for every X,Y e ^^(lE) and X, ^ 0; 

(m) \\J{X) - J(Y)\\ = h{X, Y) for every X,Y & €ciK); 

(Hi) W is a convex cone in ¥, complete under the metric induced by the norm of 
F. 

It is worth noting that, since £c(E) is a complete metric space under the 
Pompeiu-Hausdorff metric h, then any nonempty closed subset of €c{¥) is a com- 
plete metric space under the induced metric. 

A nonempty set W cz Cc(E) is called a semilinear complete metric space if: 
(oi) W is closed in £c(IE); (02) W is stable under the operations of addition and 
multiplication by nonnegative scalars, i.e., for every X, F e W and A ^ we have 
X + y 6 W and AX 6 W. 

It is evident that the space Cc(E) itself is a semilinear complete metric space. 

Retaining the above notations we now prove a useful variant of Proposition [^31 

Proposition 6.5. Let W a £c(IE) be a semilinear complete and separable metric 
space. Let J be the restriction of J to W. Then there exists a separable Banach 
space (F, || • ||) such that the map J : W ^ W, where W = J(W) c F has the 
following properties: 

{i) J {XX + fiY) = X.J{X) + ^J{Y) for every X,Y e W and X, ^ 0; 

(m) \\J{X) - J{Y)\\ = h{X, Y) for every X,Y e W; 

(Hi) W is a convex cone in F, complete under the metric induced by the norm of 
F. 

Proof. Set F = span W, where span W denotes the linear span of W, and observe 
that F c F, since W c F by Proposition [63] Moreover F is separable, because the 
separability of W implies that W as well as its linear span are separable. Therefore 
F, as a closed and separable linear subspace of F, is actually a separable Banach 
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space uneder the induced norm of F. It remains to verify (i) — (Hi). 

(i) Let X,Y eW and A, ^ 0. Since \X + fiY e W, then by Proposition 16.41 one 
has 

J{XX + fiY) = J{\X + \Y) = XJ{X) + fiJ(Y) = XJ{X) + nJ{Y). 

(ii) This is obvious, since for X,Y e W, 

\\J{X) - J{Y)\\ = \\J{X) - J{Y)\\ = h{XX)- 

[Hi) The set W <z F is a convex cone. In fact let s, t ^ and ^, ry e W be arbitrary. 
Then ^ = J{X), ri = J{Y) for some X,Y eW and thus 

+ h] = sJ{X) + tJ{Y) = J{sX + tY) = J{sX + tY), 

since sX + tY & W. Hence s£, +tr] e W, and so W is a convex cone. Moreover W is 
closed in F. To see this, consider an arbitrary sequence {£,n}n=i ^ converging 
to some ^ e F. For each n e N there exists X„ e W such that J(X„) = By 
virtue of (m) the sequence {Xn}n^i <^ "VV is Cauchy and thus, as W is complete, it 
converges to some X e W. Set ^ = J{X). Since by (m) 

||^„ - a = II WO - '^~(^)ll = Hx^.x), 

it follows that {£,n}n=i converges to ^ as n ^ +oo. By the uniqueness of the limit 
one has ^ = i.e., ^ = J{X). Hence ^ e W and thus W is closed in F. This 
completes the proof. □ 

Proposition 6.6. Let W be a semilinear complete and separable metric space and, 
retaining the notation of Provosition \6.5[ let W = J(W). Let F 6 L^(f2, W). Then 
the map ^ : ^ W given by £,(ijj) = J{F{uj)), to e fl, is Bochner integrable on Q., 
i.e., ^ 6 L^(f7,F). Moreover, 

J (^(H)jFdP^ = j^dP, (6.1) 
where the integral on the right-hand side is an element of W. 

Proof As F e L^{n,W), there is a sequence {G„}+Zi c Z^{n,W) of countably- 
valued maps G„ : Q —>■ W converging to F uniformly a.s. in fl. Consider the 
corresponding sequence {^n}n'fi, where ^„ : ^ F is given by ^„(w) = J(G„(w)), 
oj e fl. Clearly {^n}n^i c L^(ri,F), since each ^„ is countably- valued and, for 
some k > 0, ||^„(a;)|| ^ H-F'Cw)! + k, a.s. on uj € i}. Moreover the sequence 
{£,n}n=i L^{il.,¥) converges to ^ uniformly a.s. in ft, because by Proposition 16.51 

W^oj) - e(w)|| = II J(G„(c^)) - J{F{uj))\\ = h{Gn{oj),F{uj)) uj e il, 

and hence ^ is measurable. Moreover ||C(w)|| ^ ||i^((u;)|| + k a.s. on il and thus 
^ 6 L^{^,¥). Furthermore, by Proposition 16.51 for each ne N one has 

J (^(H)jG„dP^ = j^,,dP, 

from which (|6.ip follows at once by letting n ^ +cc. Moreover the integral on the 
right-hand side of (|6.ip is an element of W, because each ^„ takes values in W, and 
W is a convex and closed cone contained in F. This completes the proof. □ 
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It is worth noting that, by Proposition l5.6l the expectation E(F) of any random 
set F 6 L^(r2,£(E)) is a nonempty bounded closed and convex subset of E, i.e., 
E{F) = C where C e ^^(E). 

Theorem 6.1. Let U be a nonempty separable subset o/C(E), equipped with the 
induced Pompeiu-Hausdorjf metric h o/£(E). Let {X„}^*^ be a sequence of inde- 
pendent identically distributed (i.i.d.) random sets Xn : ^ IL with expectation 
E{Xn) = C, neN, where C e €c(E). Then 



C0Xi{u}) -\ \- CoXniuj) ft 

> L as n —>■ +CO, a.s. on \l. 

n 

Proof. Set V = {Ze Cc{E) \ Z = coX where X eU} and define 

Wo = {Z 6 €c{E) I Z = AiXi + . . . + A„X„ 

for some Xi e V, Xi ^ 0,i = 1, . . . ,n, n e N}, 

and 

W = cle,(E)[Wo]. 

The set V is separable. To see this let {Xn}^^\ c U be a sequence dense in 
11. Then the sequence {coXn}n=i <^ V is dense in V. In fact, given e > and 
Z e V, i.e., Z = WX for some X e U, then taking a Xn so that h{Xn,X) < e 
one has /i(coX„,coX) < e. Clearly, the separability of V implies that both Wq 
and W are separable. As £c(IE) is complete, and W is closed in £c(E) it follows 
that W equipped with the Pompeiu-Hausdorff metric h is a complete metric space. 
In addition W is stable under the operations of addition and multiplication by 
nonnegative scalars because Wq is so. Hence, W c £c(E) is a semilinear complete 
and separable metric space. Then, by virtue of Proposition 16. 5[ there exists a 
separable Banach space F such that, denoting by J the restriction of J to W and 
setting W = J^W), the properties of Proposition 16.51 are satisfied. 

Now consider the sequence of random sets coX„ : f2 ^ W. In view of |22) . 
{coXn}n'fi is a sequence of i.i.d. random sets because {Xn}n=i is so and, moreover, 
the map co : £(E) £c(IE) is nonexpansive. For each n e N let : ^ W be 
given by 

^„(a;) = J(coX„(w)) Lj efl. 

As the map J : W — > W is nonexpansive, it follows that {£,n}n=i is a sequence 
of i.i.d. random variables and, moreover, each ^„ takes values in F, a separable 
Banach space. Furthermore for each n e N, 



E{^n) = kndP = \j{coXn)dP = J f (H) \{coXn)dp) = J{E{X„ 
Jn Jn V Jn J 



)) = J(C), 



since the Hukuhara integral equals E{Xn) by Proposition 15. 6[ and E{Xn) = C, 
n 6 N, by hypothesis. By virtue of the SLLN theorem for random variables in a 
separable Banach spaces (see jl^) it follows that 

^i(w) + ■■■ +$„(a;) ~ 

— — J\^) as n ^ +00, a.s. on il. 

n 
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Consequently, by virtue of ProDOsition l6.5l 



coXi{uj)-\ \-coXn{uj) /I 

— ^ C as n ^ +00, a.s. on il. 

n 

This completes the proof. □ 

Theorem 6.2. Let U be a nonempty separable subset of £(E) equipped with the 
induced P ompeiu-Haus dor ff metric h o/£(E). Let {Xn}n=i be a sequence of i.i.d. 
random sets X„ : —>■ XL with expectation E(Xn) = C, n e N, where C e £c(IE). 
Furthermore suppose that 

{X„(a;)}+^i c Z(cj) a.s. onn, (6.2) 

where, for e f2 a.s., '^{ijj) is a nonempty compact subset ofU. Then 



Xi{u;) + ■ ■ ■ + Xniuj) F „ , „ 

>C asn—^+co, a.s. on\l. 

n 

If, in addition, C e £c(IE) is compact, then 



Xi{u) + ■ ■ ■ + Xn{uj) h „ , „ 

>C asn—>- +00, a.s. on\l. 



n 

Proof. By virtue of Theorem 16.11 



coXi(a;)H hcoX„(u;) h , ^ 

C as n ^ +CO, a.s. on il. 



n 

and thus, a fortiori. 



coXi(a;)H hcoX„(a;) f , „ 

— > C as n ^ +00, a.s. on il. 

n 

From the latter and (|6.2p . by Theorem 14. 11 it follows that 



^^i^) + ---+XnH F^C asn^+00, a.s. on a (6.3) 

n 

If C 6 £c(E) is also compact, then from (16. 3p . in view of Theorem 14. 2 [ one has 



Xiiu) + ■ ■ ■ + X„{uj) h , „ 

> C as n ^ +00, a.s. on il. 

n 

This completes the proof. □ 

Corollary 6.1. Let {Xn}^^\ be a sequence of i.i.d. random sets Xn : fl Z, 
where Z is a compact subset of€(E), with expectations E(Xn) = C , n e N, where 
Ce€c{E). Then 



coXi{u})-\ \- coXn{uj) h „ , „ 

>C as n — >■ +00, a.s. on it 



and 



Xi{u;) + ■ ■ ■ + Xn{uj) F „ , „ 
>C as n ^ +00, a.s. on il. 



n 
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Proof. The statement follows from Theorems 16.11 and 16.21 since 2. is a separable 
subset of e:(E). □ 



Remark 6.1. It is worth noting that in Theorems 16.11 and 16.21 the separability 
assumption on U and the compactness assumption on 2,(uj) do not imply that the 
corresponding sets J7 c E and 1/ c E given by 

U = [j{X \X eU}, V = [j{Xniio)\neN} 

be respectively separable, compact. To see this it suffices to consider the trivial 
examples 11 = {B} and Xn{uj) = B, forweil, n e N, where B denotes the closed 
unit ball in an infinite dimensional non-separable Banach space. 
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